QUESTIONNAIRE ANALYSIS SYSTEM 

BACKGROUND OF THE INVENTION 

5 1. Technical Field of the Invention 

The present invention relates to a questionnaire analysis 
system, and more particularly to a questionnaire analysis 
system using text automatic classification, natural language 
processing, and network utilization. 

10 2. Description of the Prior Art 

The operation for extracting general features and tendency 
from questionnaire reply statements including free reply 
description in natural language obtained through the network 
such as the Internet has been conventionally done almost 

15 manually. Text mining tools such as DE-FACTO developed by 
Dentsu (published in leaflet), Keyword Associator of Fujitsu (I. 
Watanabe: Divergent thought support system "Keyword 
Associator" 2nd edition, research group paper of 15th Meeting 
of System Engineering Group of Society of Measurement and 

20 Automatic Control of Japan, July 1994), and "HIPS" (Watanabe, 
Miki, Nitta, Sugiyama: Hybrid thought support system HIPS, 
research group paper of 17th Meeting of System Engineering 
Group of Society of Measurement and Automatic Control of 
Japan, January 1995) were used for extracting the relationship 

25 of words from the text information. However, these tools could 
not express the features of questionnaire reply statements in a 
format of a rule. 

So far, nothing has been known about the system or service 
for collecting and analyzing questionnaire reply statements 
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including free reply description in natural language 
automatically through the network such as the internet, and 
distributing the analysis results, if necessary, to the claimant. 
For example, in JP 11-066036 A (1999), or JP 11-143856 A 
5 (1999), the technology for inquiring through the network and 
accumulating the replies in the database is disclosed, but 
features of questionnaire reply statements are not extracted in 
a format of a rule. 

In the conventional manual questionnaire analysis 
10 mentioned above, when there are huge number of the number 
Q of questionnaire replies, the manual analysis becomes 

m inefficient, 

J In text mining tools such as DE-FACTO and HIPS, features 

l2 of questionnaire replies cannot be extracted in a format of a 

15 rule. Therefore, it was not sufficient from the viewpoint of 
5^ presentation of compact and easy knowledge. 

Although conventional text classification tools used for 
J3 information retrieval are also useful for analysis of 

questionnaire replies, they are not used yet in the analysis of 
20 questionnaire replies including free reply description in natural 
language. 

Therefore, an object of the present invention is to provide a 
questionnaire analysis system capable of automatically 
presenting knowledge in a compact and easy rule from 
25 questionnaire reply statements including free reply description 
in natural language by using a text classification engine. 

Another object of the present invention is to provide a 
questionnaire analysis system for distributing analysis results 
to the claimant by automatically extracting the knowledge in 



2 



the rule format from the questionnaire reply statements 
collected through the network. 

A questionnaire analysis system of the present invention 
comprises means for inputting a questionnaire statement 
5 including free reply description in natural language, a network 
for transmitting the questionnaire reply statement, a database 
for accumulating the transmitted questionnaire reply 
statements, and a text classification engine for reading out the 
questionnaire reply statements from the database and learning 

10 a rule for classifying the questionnaire reply statements. 

Further, a questionnaire analysis system of the present 
invention may comprise means for inputting a questionnaire 
statement including free reply description in natural language, 
a database for accumulating the transmitted questionnaire 

15 reply statements, and a text classification engine for reading 
out the questionnaire reply statements from the database and 
learning a rule for classifying the questionnaire reply 
statements. 

Moreover, a questionnaire analysis system of the invention 
20 may comprise means for inputting a questionnaire statement 
including free reply description in natural language, a network 
for transmitting the questionnaire reply statement, a database 
for accumulating the transmitted questionnaire reply 
statements, a text classification engine for reading out the 
25 questionnaire reply statements from the database and learning 
a rule for classifying the questionnaire reply statements, and 
means for distributing the rule through the network according 
to a request from a claimant. 

According to the present invention, by receiving orders for 
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enterprise image survey or questionnaire about specific 
merchandise or service from claimants, the questionnaire is 
operated on the network, and the questionnaire reply 
statements including free reply description in natural language 
5 collected online through the network are accumulated in the 
database, and questionnaire reply statements are called 
therefrom, and the rules obtained by using the text 
classification engine are sold to the claimants as the analysis 
results. 

10 Further, according to the present invention, by receiving 
P orders for enterprise image survey or questionnaire about 

m specific merchandise or service from claimants, the 

questionnaire is operated, and the questionnaire reply 
C statements including free reply description in natural language 

15 are collected at once, and accumulated in the database, and 
H questionnaire reply statements are called therefrom, and the 

analysis results obtained by using the text classification engine 
Q are sold to the claimants. 

Furthermore, according to the present invention, by receiving 
20 orders for enterprise image survey or questionnaire about 
specific merchandise or service from claimants, the 
questionnaire is operated on the network, and the 
questionnaire reply statements including free reply description 
in natural language collected online through the network are 
25 accumulated in the database, and questionnaire reply 
statements are called therefrom, and the analysis results 
obtained by using the text classification engine are distributed 
through the network to the claimants when requested. 
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BRIEF EXPLANATION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a configuration of a 
questionnaire analysis system according to a first embodiment 
5 of the present invention. 

Fig. 2 is a diagram showing an example of questionnaire 
reply statements accumulated in a database in Fig. 1. 

Fig. 3 is a flowchart showing processing in a text 
classification engine in Fig. 1, 
10 Fig. 4 is a flowchart showing a more specific processing of 
O attribute selecting step in Fig. 3. 

m Fig. 5 is a flowchart showing a more specific processing of 

a 

m rule learning step in Fig. 3. 

Fig. 6 is a diagram showing an example of rule format 
''^ 15 knowledge (stochastic decision list) as a result of analysis by 

-3 

y the text classification engine in Fig. 1. 

Fig. 7 is a diagram showing other example of rule format 
y knowledge (stochastic decision list) as a result of analysis by 

the text classification engine in Fig. 1. 
20 Fig. 8 is a block diagram showing a configuration of a 
questionnaire analysis system according to a second 
embodiment of the present invention. 

Fig. 9 is a block diagram showing a configuration of a 
questionnaire analysis system according to a third embodiment 
25 of the present invention. 

Fig. 10 is a block diagram showing a configuration of a 
questionnaire analysis system according to a fourth 
embodiment of the present invention. 

Fig. 11 is a block diagram showing a configuration of a 
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questionnaire analysis system according to a fifth embodiment 
of the present invention. 

Fig. 12 is a block diagram showing a configuration of a 
questionnaire analysis system according to a sixth embodiment 
of the invention. 

Figs. 13A to 13L are formulae (1) to 12 for calculating ASC 
(co) (the difference between the stochastic complexity (SC) of a 
text set without consideration of appearance of wordco and the 
SC with consideration thereof, and A ESC (t) (the decrement of 
the ESC ( extended SC),when a term "t" is selected. 

PREFERRED EMBODIMENT OF THE INVENTION 

First Embodiment 

Fig. 1 is a block diagram showing a configuration of a 
questionnaire analysis system according to a first embodiment 
of the invention. The questionnaire analysis system of the 
first embodiment comprises respondent computers 111 to UN 
(N being a positive integer), a network 12, a database 13, and a 
text classification engine 14. 

The respondent computers 111 to UN are computers, 
portable information terminals, cellular phones, and other 
devices having transmission function of message, mail and the 
like, which are connected to the network 12. 

The network 12 includes various networks, whether wired or 
wireless, such as public networks, exclusive networks, or LAN 
(local area network). 

The database 13 is connected to the network 12, and 
questionnaire reply statements from plural respondents 



transmitted from the respondent computers 111 to UN through 
the network 12 are accumulated herein. 

The text classification engine 14 reads out plural 
questionnaire reply statements from the database 13, extracts 
5 a rule for classifying the questionnaire reply statements, and 
issues the rule to the claimant. The text classification engine 
14 includes morpheme analysis means 15 for analyzing 
morphemes in all sentences in the questionnaire reply 
statements accumulated in the database 13, category-text 
10 designating means 16 for designating the category and text in 
O the text classification engine 14, attribute selecting means 17 

m for selecting attributes in plural questionnaire reply statements 

Q 

Ijl being read in from the database 13, rule learning means 18 for 

£-5. 

\^ learning the rule for expressing the correspondence of text and 

r 15 category on the basis of the words selected by attributes by the 

attribute selecting means 17, and rule output means 19 for 
issuing the rule. 

The text classification engine 14 is an engine for learning the 
corresponding relation of the category and text as a 
20 classification rule, and, for example, an engine proposed by Li 
and Yamanishi can be used (H. Li and K. Yamanishi: Text 
Classification Using ESC-based Stochastic Decision Lists, 
Proceedings of 1999 International Conference on Information & 
Knowledge Management, pp. 122-130, 1999). This text 
25 classification engine basically conforms to the system of 
"Forming method and apparatus of decision list" disclosed in 
Japanese Patent No. 2581196. 

Fig. 2 shows a composition of a set of questionnaire reply 
statements accumulated in the database 13. Each row 
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expresses a questionnaire item, and each line shows the reply 
statement of one person. 

Referring to Fig. 3, processing of the text classification engine 
14 comprises morpheme analysis step 31, designating step 32 of 
5 text and category, attribute selecting step 33, rule learning step 
34, and rule output step 35. 

Referring to Fig. 4, a more specific processing of attribute 
selecting step 33 includes A SC(co) computing step 41, and 
attribute selecting step 42. 
10 Referring to Fig. 5, a more specific processing of rule learning 
O step 34 includes data forming step 51, growing step 52, and 

IB pruning step 53. 

m Fig. 6 is a diagram showing an example of rule format 

H knowledge (stochastic decision list) as a result of analysis by 

,f 15 the text classification engine 14. 

Fig. 7 is a diagram showing other example of rule format 
knowledge (stochastic decision list) as a result of analysis by 
the text classification engine 14. 

In the questionnaire analysis system of the first embodiment 
20 having such configuration, the operation is explained below. 

When questionnaire respondents send questionnaire reply 
statements from the respondent computers 111 to UN, the 
questionnaire reply statements are stored into the database 13 
through the network 12. Suppose the number of respondents 
25 to be N. At this time, the questionnaire reply statements may 
include free reply description in natural language. 

The text classification engine 14, first by the morpheme 
analysis means 15, analyzes morphemes in all sentences of 
questionnaire reply statements accumulated in the database 13 
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(step 31). 

Next, by the category-text designating means 16, the text 
classification engine 14 causes the operator to designate the 
category and text in the questionnaire reply statements (step 
5 32). Herein, designation of category is to classify by paying 
attention to the replies in one column. For example, it is the 
category designation that, relating to the first row in Fig. 2, the 
replies are classified into "company A", and "other than 
company A". The text designation is to designate the rows to 
10 be used in analysis except for the row used in category 
O designation. For example, the text is designated by selecting 

m the second row in Fig .2, 

o 

iji Further, the text classification engine 14, by the attribute 

U selecting means 17, selects the attributes in plural 

r 15 questionnaire reply statements being read in from the database 

y 13 (step 33). The attribute selection is to select a word which 

is important for expressing the correspondence of text and 
H category. 

Then, the text classification engine 14 learns the rule for 
20 expressing the correspondence of text and category on the basis 
of the word selected by attribute by the rule learning means 18 
(step 34). For example, when the category and text are 
designated as stated above, the rule is obtained as shown in Fig. 
5. 

25 The rule in Fig. 6 shows that if the word "easy to use" is found 
in the text by reading the first line, 92.0% of the respondents 
assume company A as the high-tech enterprise. If the word 
"easy to use" is not found, next, checking if the words "future" 
and "private" appear at the same time, and when found, it 
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means that 87.2% of the respondents assume company A as the 
high-tech enterprise. Thereafter, similarly, according the rule 
of if-then-else pattern, the conditional sentences are read from 
top to bottom. Such rule is an easy and compact expression of 
the relation between the high-tech enterprise and high-tech 
feeling. 

Picking up other company B, when the category is designated 
into "company B" and "other than company B", the rule in Fig. 7 
is obtained by the same procedure. 

Comparing the rule of company B in Fig. 7 with the rule of 
company A in Fig. 6, the high-tech feeling of the respondents 
assuming company A as the high-tech enterprise is mainly 
based on the ease of use and preference sensation, while the 
high-tech feeling of the respondents assuming company B as 
the high-tech enterprise is known to be mainly based on the 
efficiency. Thus, by comparing the rules, the questionnaire 
replies can be analyzed easily. 

Finally, the text classification engine 14, by the rule output 
means 19, issues the knowledge of the analysis result in the 
rule format to the claimant (step 35). 

As an example of knowledge in rule format, herein, the 
stochastic decision rule is discussed, and the attribute selecting 
step 33 for creating it and the rule learning step 34 are more 
specifically described below. 

The stochastic decision list is a ranked list of stochastic rule 
of if-then pattern as shown in Fig. 6. Each stochastic rule has 
a pattern of "c = 1 t (probability p)", where c = 1 is the 
decision of classification, t is the condition of classification, and 
(probability p) is the probability. 
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First, attribute selecting step 33 is explained. 

The attribute selection is to collect words closely related with 
the category in the given category (for example, company A and 
other than company A). More specifically, as shown in Fig. 4, 
at step 41, in each word co appearing in the text, the difference 
ASC(co) between the stochastic complexity (SC) of the text set 
without consideration of onset of the word co and the SC with 
consideration thereof is computed, and at step 42, when the 
difference ASC(co) is greater than the given threshold r , the 
word CO is selected as an attribute. 

A practical method of computing the SC is explained. Sets 
of texts in the entered questionnaire reply statements are 
expressed as 

(di, Ci), (d2, C2), (d^, cj 
where d^ denotes the i-th text, and is expressed as the row of 
words appearing in the i-th text, c^ denotes the value of category 
(label) corresponding to the i-th text, and each Ci is 1 if 
belonging to the given category (company A) or 0 otherwise 
(other than company A), and m is the number of texts. 

Further, a label sequence is expressed as c^" = Ci, c^,, and 
a text sequence is expressed as d"" = di, d^^^. The SC of label 
sequence c^" is calculated as in formula (1), where m^ is the 
number of labels in which the value is 1 in label sequence c"", 
and log is the natural logarithm. 

H(z) is defined by formula (2). 

For example, as discussed by J. Rissanen and Fisher 
information and stochastic complexity (IEEE Trans, on 
Information Theory, 42 (1), 40-47, 1996), SC(c°^) is the shortest 
description length for describing the label sequence c°^ by using 



the given model (herein, Bernoulli model). Suppose 0°"^ is a 
label sequence composed of label c^ in which word co appears in 
the corresponding text d^, where m^ is the number of labels 
in C"^^ . 

Then, the value of SC in C"""^ can be calculated by formula (3), 
where m^^^ is the number of labels of which value is 1 in . 

On the other hand, suppose C"'"' is a label sequence 
composed of label c^ in which word o does not appear in the 
corresponding text di, where m^^ is the number of labels in C""" 

Then, the value of SC in C'""''^ can be calculated by formula 
(4). 

The difference A SC(a)) between the SC without 
consideration of appearance of word co and the SC with 
consideration thereof is calculated by formula (5). 

The word o) large in the difference A SC(co) is a word 
appearing very frequently or hardly in a given category. Such 
words are considered to be closely related with the category. 
Supposing T to be a given threshold, the word co in the relation 
of ASC(co) > T is selected as an attribute. 

The rule learning step 34 is explained below. 

Suppose there are n words selected of attribute, being coj, 
co^. At step 51, first of all, sets of entered texts are expressed 
as follows. 

(di, Ci), (dg, Cg), (d^, cj 

Here, each d^ expresses a binary vector (generally, a multi- 
valued discrete vector) 

di = (cOii, C0i2, cOiJ (i = 1, m) 

Here, cOij is 1 when the word cOj obtained by attribute selection 



12 



appears in the i-th text, or 0 otherwise (j = 1, n), q expresses 
the value (label) of the category corresponding to the i-th text, 
and each Ci is 1 when belonging to the specified category, and 0 
otherwise, and m is the number of texts. 

At step 52, the rule of if-then-else pattern is selected, and 
sequentially added to the stochastic decision list A. This is 
called "growing." For selection of rules, for example, the 
extended stochastic complexity (ESC) minimum principle is 
employed. 

The operation is as follows. Suppose k is a given positive 
integer. A set of all possible k terms (up to k link words of 
word co) on the basis of the word co by attribute selection is 
supposed to be T. From terms t of the set T, those not 
appearing in the text at all are excluded. An empty stochastic 
decision list A is prepared. Next, the rule of the largest 
decrement of ESC value is sequentially added to the stochastic 
decision list A. 

Herein, the ESC is computer as follows. The whole data set 
D is expressed as sets of data in a format of 

(di, Ci), (dg, Cg), (d^, c^) 
and label sequence c^" = Ci, c^. The value of the ESC of label 
sequence c^^ can be approximated as in formula (6). 

This is one approximate format of the original ESC proposed 
by K. Yamanishi in his paper (A decision-theoretic extension of 
stochastic complexity and its applications to learning, IEEE 
Trans. Inform. Theory, 44, 1424-1439, 1998). 

Herein, X is a positive constant. Loss (c"^) is the number of 
errors in default classification. The default classification is to 
assume all labels are 0, for example, t is a term in the set T. 



Suppose c"^*' is a label sequence composed of label c^ in which 
term "t" is true in the corresponding text d^, where m^ is the 
number of labels in c"^^ . 

Suppose Loss ( 0°"^ ) is the number of errors when classifying 
5 by term "t". 

On the other hand, c "^"^ is a label sequence composed of label 
Ci in which term "t" is false in the corresponding text d^, where 
m-^t is the number of labels in c .Here, "« t expresses 
negation of term "t". Suppose Loss (c """^^ ) is the number of 
10 errors when classifying by t . 

The ESC values of c and c "^^^ can be calculated by formula 
(7) and formula (8), respectively, 
ifl When classifying by term "t", the decrement AESC(t) of the 

ESC value is calculated in formula (9). 
15 According to the ESC minimum principle, term "t" is selected 
so that A ESC(t) may be minimum. When such t = t* is 
selected, the number of data of whole data set D in which it is 
true is supposed to be m^* and of such data, the label, for 
example, greater in number is supposed to be c = 1, and the 
20 number of c = 1 is supposed to be m^* ^ , and the number of c = 0 
is supposed to be m^* ' . 

The rule "c = 1 t* (probability)" is added to the stochastic 
decision list A. Herein, the probability value p is calculated, 
for example, by formula (10) by using the method of Laplacean 
25 estimation. 

Excluding term " t* " from the set T, a new set T is obtained, 
and excluding all data rendering term " t* " true from the whole 
data set D, a new whole data set D is obtained, and the same 
operation is repeated until the whole data set D becomes empty. 

14 
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Instead of the standard ESC used hereabove, the standard SC 
used in attribute selection may be used. 

At step 53, since the stochastic decision Hst A obtained at 
step 52 may excessively conform to the learning data, the rules 
are removed one by one from the last one of the stochastic 
decision list A consecutively until none should be removed from 
the viewpoint of the ESC minimum principle. This process is 
called clipping. 

In this case, the manner of application of the ESC minimum 
principle is explained below. First, the value of the ESC 
corresponding to the stochastic decision list A of label sequence 
c^" is defined by formula (11) as the sum of ESC values 
corresponding to all terms t in the stochastic decision list A. 

Here, ESC( c ) is calculated by formula (7). 

Next, the whole ESC value of label sequence c"" and 
stochastic decision list A are defined by formula (12), where X' is 
a positive constant, and L(A) is a code length for encoding the 
stochastic decision list A. Specifically, it is calculated as L(A) 
= logT + log(T-l) + ... + logT (T-i+1), where T is the number of 
possible terms t, and i is the number of rules in the stochastic 
decision list A. 

Suppose A expresses the stochastic decision list before 
clipping, and A' is the stochastic decision list after clipping. 

When ESC (c^|A) ^ ESC (c°^|A*), in other expression, when 
ESC (c^|A') - ESC (c°^|A) ^ X' (L(A) - L(A)), the clipping 
procedure continues, and when this condition is no longer 
satisfied or there is no rule left to be chpped, the stochastic 
decision list A obtained at this moment is delivered. Thus, the 
stochastic decision list A small in the ESC on the whole is 



15 



issued. 

In the questionnaire analysis system of the first embodiment, 
rules of analysis results can be automatically extracted from 
the questionnaire reply statements including free reply 
5 description in natural language collected through network 12. 

In the questionnaire analysis system of the first embodiment, 
as the text classification engine 14, by using the engine 
proposed by Li and Yamanishi (H. Li and K. Yamanishi: Text 
Classification Using ESC-based Stochastic Decision Lists, 

10 Proceedings of 1999 International Conference on Information & 
Knowledge Management, pp. 122-130, 1999), by the 
computation amount of O (n^m), rules can be extracted from the 
questionnaire reply statements at high speed, where n is the 
number of words of attribute selection from the questionnaire 

15 reply statements, m is the number of questionnaire reply 
statements, and k is the maximum number of words included in 
the link words relating to one condition. Hence, efficient 
automatic analysis of questionnaire reply statements is 
possible. The obtained rules can express the questionnaire 

20 reply statements belonging to a specific category in compact 
and easy format of if-then-else pattern. 

The questionnaire analysis system of the first embodiment 
can be applied, for example, in the following business. 
Receiving orders for enterprise image survey or questionnaire 

25 about specific merchandise or service from claimants, the 
questionnaire of the items as shown in Fig. 2 is operated on the 
network 12, and the questionnaire reply statements including 
free reply description in natural language collected online 
through the network 12 are accumulated in the database 13, 
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and questionnaire reply statements are called therefrom, and 
the rules obtained by using the text classification engine 14 are 
sold to the claimants as the analysis results. 

Second Embodiment 
Fig, 8 is a block diagram showing a configuration of a 
questionnaire analysis system according to a second 
embodiment of the invention. The questionnaire analysis 
system of the second embodiment comprises questionnaire 
reply input means 81, a database 82, and a text classification 
engine 83, 

The questionnaire reply input means 81 is directly connected 
to the database 82 without connecting through network. 

The database 82 accumulates questionnaire reply statements 
from plural questionnaire respondents. 

The text classification engine 83 is exactly the same as the 
text classification engine 14 in the questionnaire analysis 
system of the first embodiment shown in Fig. 1. Therefore, the 
corresponding parts are identified with same reference 
numerals, and their detailed description is omitted. 

The operation of the questionnaire analysis system of the 
second embodiment having such configuration is explained 
below. 

The questionnaire reply input means 81 is directly connected 
to the database 82 without connecting through network, and 
receives questionnaire reply statements including free reply 
description in natural language. 

The database 82 accumulates questionnaire reply statements 
from plural questionnaire respondents. 

The text classification engine 83 reads out plural 



questionnaire reply statements from the database 82, extracts 
the rules for classifying the questionnaire reply statements, 
and issues the rules of analysis result to the claimant. The 
detail of the operation of the text classification engine 83 is 
same as that of the text classification engine 14 of the 
questionnaire analysis system of the first embodiment, and the 
detailed description is omitted. 

The questionnaire analysis system of the second embodiment 
can be applied, for example, in the following business. 
Undertaking an enterprise image survey or a questionnaire 
about specific merchandise or service, the questionnaire of the 
items as shown in Fig. 2 is operated, and the questionnaire 
reply statements including free reply description in natural 
language are collected at once, and accumulated in the 
database 82, and questionnaire reply statements are called 
therefrom, and the analysis results obtained by using the text 
classification engine 83 are sold to the claimants. 

Third Embodiment 

Fig. 9 is a block diagram showing a configuration of a 
questionnaire analysis system according to a third embodiment 
of the invention. The questionnaire analysis system of the 
third embodiment comprises respondent computers 911 to 91N, 
a network 92, a database 93, a text classification engine 94, and 
a claimant computer 95. 

The respondent computers 911 to 91N are computers, 
portable information terminals, cellular phones, and other 
devices having transmission function of message, mail and the 
like, which are connected to the network 92. 

The network 92 includes various networks, whether wired or 
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wireless, such as public networks, exclusive networks, or LAN. 

The database 93 is connected to the network 92, and 
questionnaire reply statements from plural respondents 
transmitted from the respondent computers 911 to 91N through 
5 the network 92 are accumulated herein. 

The text classification engine 94 is same as the text 
classification engine 14 in the questionnaire analysis system of 
the first embodiment shown in Fig. 1, except that the rule 
output means 19 can transmit the knowledge of the rule format 
10 as a result of analysis through the network 92. Therefore, 
o same reference numerals are given to the corresponding parts 

and detailed description is omitted. 

The claimant computer 95 requests knowledge of rule format 
u as a result of analysis to the text classification engine 94 

15 through the network 92, and receives the knowledge of rule 
y format of analysis result from the text classification engine 94 

[p^ through the network 92. 

The operation of the questionnaire analysis system of the 
third embodiment having such configuration is explained 
20 below. 

The questionnaire respondents send questionnaire reply 
statements including free reply description in natural language 
from respondent computers 911 to 91N through the network 92. 
Suppose the number of respondents to be N. 
25 The database 93 is connected to the network 92, and 
accumulates questionnaire reply statements from plural 
questionnaire respondents. 

The text classification engine 94 reads out plural 
questionnaire reply statements from the database 93, an 
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extracts the knowledge of rule format for classifying the 
questionnaire reply statements. The text classification engine 
94 is connected to the network 92, and distributes the 
knowledge of rule format of analysis result through the network 
92 depending on the request from the claimant computer 95. 
The detail of operation of the text classification engine 94 is 
same as that of the text classification engine 14 of the 
questionnaire analysis system of the first embodiment, except 
that the knowledge of rule format of analysis result is 
distributed through the network 92, and the description of 
detail is omitted. 

The questionnaire analysis system of the third embodiment 
can be applied, for example, in the following business. 
Undertaking an enterprise image survey or a questionnaire 
about specific merchandise or service, the questionnaire of the 
items as shown in Fig. 2 is operated on the network 92, and the 
questionnaire reply statements including free reply description 
in natural language collected online through the network 92 are 
accumulated in the database 93, and questionnaire reply 
statements are called therefrom, and the analysis results 
obtained by using the text classification engine 94 are 
distributed through the network 92 to the claimants when 
requested. 

Fourth Embodiment 
Fig. 10 is a block diagram showing a configuration of a 
questionnaire analysis system according to a fourth 
embodiment of the invention. The questionnaire analysis 
system of the fourth embodiment is similar to the questionnaire 
analysis system of the first embodiment shown in Fig. 1, except 
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that a recording medium 102 recording a text classification 
engine program is incorporated in a computer 101 connected to 
the database 13, and the other composition is same as that of 
the questionnaire analysis system of the first embodiment, and 
corresponding parts are identified with same reference 
numerals and detailed description is omitted. 

In the questionnaire analysis system of the fourth 
embodiment having such configuration, the text classification 
engine program is read into the computer 101 from the 
recording medium 102, and controls the operation of the 
computer 101 as the text classification engine 14 including the 
morpheme analysis means 15, category-text designating means 
16, attribute selecting means 17, rule learning means 18, and 
rule output means 19. The detail of operation of the text 
classification engine 14 on the computer 101 is exactly same as 
in the case of the questionnaire analysis system of the first 
embodiment, and detailed description is omitted. 

Fifth Embodiment 
Fig. 11 is a block diagram showing a configuration of a 
questionnaire analysis system according to a fifth embodiment 
of the invention. The questionnaire analysis system of the 
fifth embodiment is similar to the questionnaire analysis 
system of the second embodiment shown in Fig. 2, except that a 
recording medium 112 recording a text classification engine 
program is incorporated in a computer 111 connected to the 
database 82, and the other composition is same as that of the 
questionnaire analysis system of the second embodiment, and 
corresponding parts are identified with same reference 
numerals and detailed description is omitted. 



In the questionnaire analysis system of the fifth embodiment 
having such configuration, the text classification engine 
program is read into the computer 111 from the recording 
medium 112, and controls the operation of the computer 111 as 
the text classification engine 83 including the morpheme 
analysis means 15, category- text designating means 16, 
attribute selecting means 17, rule learning means 18, and rule 
output means 19. The detail of operation of the text 
classification engine 83 on the computer 1 1 1 is exactly same as 
in the case of the questionnaire analysis system of the second 
embodiment, and detailed description is omitted. 

Sixth Embodiment 

Fig. 12 is a block diagram showing a configuration of a 
questionnaire analysis system according to a sixth embodiment 
of the invention. The questionnaire analysis system of the 
sixth embodiment is similar to the questionnaire analysis 
system of the third embodiment shown in Fig. 3, except that a 
recording medium 122 recording a text classification engine 
program is incorporated in a computer 121 connected to the 
database 93, and the other composition is same as that of the 
questionnaire analysis system of the third embodiment, and 
corresponding parts are identified with same reference 
numerals and detailed description is omitted. 

In the questionnaire analysis system of the sixth embodiment 
having such configuration, the text classification engine 
program is read into the computer 121 from the recording 
medium 122, and controls the operation of the computer 121 as 
the text classification engine 94 including the morpheme 
analysis means 15, category-text designating means 16, 
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attribute selecting means 17, rule learning means 18, and rule 
output means 19. The detail of operation of the text 
classification engine 94 on the computer 121 is exactly same as 
in the case of the questionnaire analysis system of the third 
embodiment, and detailed description is omitted. 
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